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Summary  of  accomplished  work: 


We  produee  algorithms  and  software  to  solve  real  problems.  However,  we 
are  not  interested  in  solving  collaborators’  problems  with  ad  hoc  methods; 
we  are  interested  in  using  their  real  problems  to  motivate  our  main  interest: 
the  design  and  rigorous  analysis  of  algorithms  under  hypotheses  as  close  as 
possible  to  the  context  in  wliieli  our  algorithms  will  be  used.  This  has  led 
us  to  unique  applications  of  nonsmooth  nonconvex  analysis  techniques.  This 
approach  is  now  being  used  by  other  researchers  in  their  methods  for  engi¬ 
neering  design  problems.  We  regard  as  one  of  our  major  career  achievements 
the  introduction  of  nonsmooth  techniques  to  nonlinear  simulation  based  de¬ 
sign. 
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Two  students  completed  their  doctoral  studies  in  summer  2008  under  the 
supervision  of  Audet.  Both  their  projects  are  directly  tied  to  this  research. 

•  Sebastien  Le  Digabel  extended  our  black  box  optimization  algorithm 
in  three  directions: 

lie  coupled  it  in  a  generic  way  to  the  variable  neighborhood  search 
algorithm  of  Hansen  et  al.,  to  globalize  the  method.  This  lead  to 
a  publication  in  Journal  of  Global  Optimization. 

—  He  extended  our  derivative-free  approach  to  higher  dimensions, 
and  he  showed  that  we  could  tackle  problems  at  least  up  to  500 
variables.  This  lead  to  a  publication  in  SIAM  Journal  on  Opti¬ 
mization. 

—  He  replaced  our  default  implementation  in  NOMAD  by  correcting 
two  drawbacks  of  the  previous  method:  the  new  method  is  deter¬ 
ministic,  and  avoids  large  cones  of  unexplored  directions  at  every 
iteration.  The  paper  is  in  its  second  round  of  review  for  SIAM 
Journal  on  Optimization. 

Le  Digabehs  thesis  was  nominated  for  the  best  thesis  in  the  Mathemat¬ 
ics  and  Industrial  Engineering  department. 

It  is  available  at  www.gerad.ca/Sebastien.Le.Digabel. 

•  Walid  Zglial  extended  our  algorithm  to  handle  more  than  one  objective 
function.  His  first  project  focused  on  the  biobjective  case,  and  it  pro¬ 
posed  and  analyzed  a  new  algorithm  It  was  published  in  SIAM  Journal 
on  Optimization.  A  second  paper,  submitted  to  Review  of  Quantitative 
Finance  and  Accounting ,  specializes  this  approach  to  optimal  portfolio 
selection  in  finance.  His  last  project  couples  our  algorithm  with  the 
normal  boundary  intersection  method  of  Das  and  Dennis,  which  was 
developed  with  support  from  and  earlier  AFOSR  grant.  His  thesis  can 
be  downloaded  from  www.gerad.ca/Walid.Zghal. 


During  the  last  years  we  have  pursued  the  development,  theoretical  analysis 
and  practical  applications,  of  direct  search  methods  for  black  box  optimiza¬ 
tion  problems.  In  addition  to  the  PhD  projects  described  above,  our  main 
accomplishments  include  the  following. 
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•  We  have  proposed  two  alternatives  to  the  drastic  extreme  barrier  ap¬ 
proach  to  constraints  in  which  all  infeasible  points  are  rejected.  The 
progressive  barrier  places  a  threshold  on  a  constraint  violation  function, 
above  which  an  infeasible  trial  point  is  discarded  from  consideration. 
Infeasible  trial  points  under  that  threshold  are  investigated  further. 
Then,  as  the  algorithm  proceeds,  the  threshold  is  reduced  so  that  the 
iterates  approach  the  feasible  region.  This  paper  uses  concepts  from 
the  Clarke  nonsmooth  calculus  to  analyze  the  convergence,  and  will 
appear  in  SIAM  Journal  on  Optimization.  The  second  approach  that 
we  proposed  starts  by  handling  constraints  by  the  progressive  barrier, 
and  as  soon  as  a  constraint  is  satisfied,  it  gets  handled  by  the  extreme 
barrier.  Intensive  testing  of  these  approaches  on  three  real  engineering 
problems  is  performed  in  a  paper  provisionally  accepted  by  Computa¬ 
tional  Optimization  and  Applications . 

•  In  order  to  compare  several  algorithms  designed  to  handle  black  box 
functions,  Professor  C.  T.  Kelley  of  North  Carolina  State  University 
made  public  a  series  of  nonlinear  well  location  optimization  problems 
that  require  the  use  of  a  flow  solver  to  evaluate  the  objective  function. 
We  were  coauthors  with  Kelley  and  others  on  a  paper  that  published 
the  numerical  results  for  6-8  different  software  packages,  including  our 
NOMAD.  Our  preliminary  results  show  that  NOMAD  often  improved 
the  initial  solution  at  a  rate  faster  than  the  other  methods,  and  often 
produced  the  best  overall  solution.  This  despite  the  fact  that  the  prob¬ 
lem  has  some  quirky  implementation  details  that  alleviate  the  need  for 
some  important  unique  features  of  NOMAD,  and  indeed,  penalize  their 
use.  This  led  to  a  publication  in  Advances  in  Water  Resources. 

•  Many  engineering  optimization  problems  involve  a  special  kind  of  dis¬ 
crete  variable  that  can  be  represented  by  a  number,  but  this  repre¬ 
sentation  has  no  utility.  Such  variables  arise  when  a  decision  involves 
some  situation  like  a  choice  from  an  unordered  list  of  options.  This 
has  two  implications:  The  standard  approach  of  solving  problems  with 
continuous  relaxations  of  discrete  variables  is  not  available,  and  the 
notion  of  local  optimality  must  be  defined  through  a  user-specified  set 
of  neighboring  points.  We  published  a  paper  in  Optimization  Letters 
that  extends  previous  work  to  the  MADS  class  of  algorithms,  and  that 
provides  limit  points  that  satisfy  some  appropriate  necessary  conditions 
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for  local  optimality  for  such  problems. 

•  Aluminum  is  the  second  most  used  metal  on  Earth.  Its  production  con¬ 
sists  of  three  well-known  steps  :  bauxite’s  extraction,  alumina  (AI2O3) 
separation  from  bauxite,  and  finally,  alumina  electrolysis.  In  the  last 
step  it  is  put  into  large  baths  of  hot  (960  °C)  molten  salts.  These  baths 
have  an  inside  carbon  lining,  which  must  be  replaced  every  5  to  8  years, 
because  they  slowly  degrade.  This  carbon  lining  and  its  attached  re¬ 
fractories  arc  called  ‘spent  potliners”,  and  they  are  contaminated  by 
fluoride,  cyanide,  and  other  hazardous  materials.  The  MADS  algorithm 
was  used  to  optimize  a  recent  spent  potliner  treatment  process.  This 
resulted  in  a  37%  reduction  of  the  treatment  cost.  A  difficult  aspect  of 
this  problem,  which  NOMAD  is  designed  to  handle,  is  that  the  model 
failed  to  return  a  value  43%  of  the  times  it  was  called.  This  led  to  a 
publication  in  Optimization  and  Engineering. 

•  Our  NOMAD  C++  software  was  entirely  revised.  The  previous  version 
had  reached  its  potential  limit,  which  was  not  surprising,  since  its  fun¬ 
damental  design  dated  back  from  2000.  The  new  version  is  now  much 
closer  to  the  algorithmic  descriptions  appearing  in  the  peer-reviewed 
papers.  NOMAD  can  now  solve  general  nonlinearly  constrained  op¬ 
timization  problems  using  the  method.  The  software  is  available  at 
www . gerad . ca/nomad. 

•  Several  papers  have  appeared  in  top  peer  reviewed  journals.  Our  pa¬ 
pers  combine  theoretical  results,  analysis  of  the  limitations  of  GPS  and 
numerical  results  on  some  real  engineering  problems.  Several  others 
are  submitted,  and  we  expect  them  to  be  accepted  in  a  near  future. 


We  continue  our  close  collaboration  with  Boeing.  ExxonMobil,  and  GM.  New 
collaborations  were  initiated  with  IREQ  on  optimal  positioning  of  GMON 
snow  sensors  to  estimate  water  income  at  hydroelectrical  dams,  with  LANL 
for  rapid  quantitative  object  reconstruction  from  a  single  x-ray  radiograph, 
and  with  UCSD  for  optimal  design  of  artificial  conduits  for  surgical  correction 
of  pediatric  cardiology  problems.  The  first  result  of  this  project  is  expected 
to  be  implanted  in  a  patient  this  fall. 
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10.  C.  Audet,  P.  Hansen,  and  F.  Messine.  Ranking  small  regular  polygons 
by  area  and  by  perimeter.  Discrete  Analysis  and  Operations  Research , 
15(3):65  73,  2008. 
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5.  T.A.  Sriver,  J.W.  Chrissis,  and  M.A.  Abramson  (2009).  Pattern  search 
ranking  and  selection  algorithms  for  mixed  variable  simulation-based 
optimization.  To  appear  in  European  Journal  of  Operational  Research , 
2009 


Submitted  for  Publication: 

1.  M.A.  Abramson,  L.  Frimannslund,  T.  Steihaug.  A  subclass  of  gen¬ 
erating  set  search  with  convergence  to  second-order  stationary  points 
Technical  Report,  Rice  CAAM-TR,  2009. 
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8.  C.  Audet,  G.  Savard,  and  W.  Zglial.  A  new  multi-objective  approach 
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Public  Presentations: 


Charles  Audet  —  Invited  plenary  talks 

•  “Derivative-Free  Optimization:  Theory  and  Practice  ”.  SIOPT  annual 
meeting ;  Boston,  USA,  May  2008. 

•  “Optimal  placement  of  tsunami  warning  buoys  using  mesh  adaptive 
direct  searches”.  Optimization  Days ;  Montreal,  Canada,  May  2007. 

•  "Mesh  Adaptive  Direct  Searches  for  Constrained  Optimization’ .  Op¬ 
timization  2007 ;  Porto,  Portugal:  July  2007. 
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J.  E.  Dennis 


Over  the  past  5  years,  John  Dennis  has  given  over  100  hour  lectures  at 
meetings,  universities,  and  government  and  industrial  labs. 


Mark  A.  Abramson 

•  Guest  lecturer  for  5-hour  optimization  shortcourse  at  the  LANL  Data 
Sciences  Summer  School. 

•  Gave  3-hour  Introduction  to  Applied  Optimization  tutorial  at  the  1st 
AIAA  Multidisciplinary  Design  Optimization  Specialist  Conference,  as 
part  of  the  46th  AIAA/ASME/ASCE/AHS/ASC  Structures,  Struc¬ 
tural  Dynamics,  and  Materials  Conference 


Changes  in  research  objectives:  None. 

The  goal  of  our  project  remains:  The  design,  analysis,  and  implementation 
of  optimization  tools  to  aid  in  making  and  documenting  decisions  involv¬ 
ing  trading  off  multiple  objectives  for  mixed  variable,  generally  constrained 
problems  with  no  global  smoothness  assumptions. 


Change  in  AFOSR  program  manager,  if  any:  None 
Extensions  granted  or  milestones  slipped,  if  any:  None 
New  discoveries,  inventions,  or  patent:  None 
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